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ABSTRACT 

This study sought to identify major factors of 
teaching evaluation as related to professors' overall teaching 
effectiveness. Undergraduate and graduate students at a university in 
the southeastern United States were asked to rate 126 business 
faculty through anonymous course evaluations. Students rated faculty 
on 12 specific items related to teaching performance; responded to 5 
items about class standing, grade point average, reason for taking 
the course, attendance, and expected grade; and rated the instructor 
on overall teaching effectiveness. A total of 6,395 evaluations were 
collected and analyzed. The results of a multiple regression analysis 
demonstrated that 12 factors were predictors of overall teaching 
effectiveness, including: (1) instructor presents material clearly; 
(2) instructor answers students' questions; (3) instructor treats 
students in a courteous and professional manner; and (4) instructor 
appears to be well-prepared for class. These data suggest that 
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Abstract 

About 3,200 undergraduate and 300 graduate students in the 
College of Business of a regional state university with more than 
17,000 students located in the southeastern United States 
evaluated 126 business faculty. The results of a multiple 
regression based on 6,395 student evaluations show that 12 
factors are predictors of overall teaching effectiveness, e.g., 
instructor presents material clearly, instructor answers 
students' questions, instructor treats students in a courteous 
and/or professional manner, and instructor appears to be well 
prepared for each class. These data suggest that students are 
fairly reasonable in considering important aspects of the 
learning process when they evaluate professors' overall teaching 
effectiveness. The results are discussed in light of the reward 
system at U.S. universities, the balance between teaching and 
research, and the changes in management education. 
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Teaching Evaluation in the College of Business: Factors 
Related to the Overall Teaching Effectiveness 
For the past several decades, teaching evaluation has been 
examined by many researchers in the literature ♦ Evaluation of 
teaching effectiveness will continue to be an interesting topic 
for faculty members, students, and researchers in the years to 
come (Basow & Silberg, 1987; Chowdhary, 1988; Fernandez, & 
Mateo, 1992; Gaski, 1987; McCallum, 1984; Marsh & Hocevar, 
1991; Marsh, Touron, & Wheeler, 1985; Poonyakanok, Thisayakorn, 
& Digby, 1986; Romero, Bonilla, Trujillo, & Rodriguez, 1989; 
Snell, Mekies, Parimanath, & Green, 1992; Tang & Tang, 1987; 
Zoller, 1992) . 

Teaching effectiveness has been examined by researchers in 
many countries around the world. For example, based on a sample 
of university students in Spain, Fernandez and Mateo (1992) 
identified two major factors related tc students 7 evaluation of 
university teaching quality: Teaching competence and 
motivational skills. Four factors have been identified using 
2,785 students in a university in Thailand: Teaching method, 
teacher-student relationship, text and materials, and evaluation 
and feedback. It has been noted that a valid student evaluation 
of instructor instrument should contain the following factors: 
(1) organization and clarity of presentation, (2) teacher-student 
interaction or rapport, (3) communication skill, (4) workload or 
course difficulty, (5) fairness of grading and examinations, (6) 
student self-rated accomplishments, and (7) a global student 
rating (Brightman, Elliott, & Bhada, 1993; Centra, 1979). 
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Teaching evaluation seems to be an important topic. 
However, there are two important issues related to teaching 
effectiveness. The first issue is related to the accuracy of 
evaluations. Therefore, the major concern is related to the 
reliability and validity of the measuring instrument itself. 

Most faculty members and administrators expressed a "great 
mistrust of student ratings" (Katz, 1973, p. 472). Gomez-Mejia 
and Balkin (1992) stated that "teaching ratings by students do 
not reflect true teaching performance; they are basically a 
popularity contest" (p. 947) . Thereby, many people do not think 
that teaching evaluation is reliable and valid. 

Baird (1987) has found that a considerably larger portion of 
rating variance can be explained by students' subjective 
assessment of learning than by actual course grades. Students' 
perceived learning correlated .88 with course evaluations and .86 
with instructor evaluations. Baird further pointed out that the 
statistics were not reduced by partialling out the effects of 
anticipated letter grade, which preserved the idea that leniency 
or student characteristics could account for at least a small 
portion of the rating-grade effect. 

Ikponmwosa (1986) found that students' evaluations of the 
instructors were not significantly influenced by knowledge of 
their grades. Thus, students can be expected to evaluate their 
instructors objectively. Marsh and Hocevar (1991) found that 
students' ratings of 6,024 classes by 195 teachers did not change 
significantly over the 13-year period. Based on these data, it 
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appears that students' evaluations of teach performance are very 
stable and consistent over time. 

The second issue deals with the usefulness of teaching 
evaluation. That is, the extent to which the results of teaching 
evaluation will be used by administrators for personnel decisions 
(i.e., tenure, promotion, and merit pay). From the perspective 
of the reward and control systems in major universities , some of 
the questions a professor may ask are: What does it mean if I 
have high teaching effectiveness? Does it pay to be an effective 
professor in classrooms? Based on Vroom's (1964) valence- 
instrumentality-expectancy (VIE) theory of motivation, is 
teaching effectiveness instrumental in achieving a professor's 
career, financial, and personal goals? 

It has been found that based on a sample of 134 
administrators and 196 faculty members of six universities, 
administrators tended to have a strong emphasis that both 
research and teaching are important, while faculty members felt 
that they need to have particular strength in one or the other 
(Chamberlain & Tang, 1993; Tang & Chamberlain, 1993). There is 
no strong relationship between teaching and faculty pay (Ferber & 
Loeb, 1974) . Thus, some may argue that there is very little 
financial incentive for excellence in teaching (Konrad & Pfeffer, 
1990) . 

In an award-winning article, Gomez-Mejia and Balkin (1992) 
found that agency theory can be meaningfully used to analyze 
internal control relationships between allocators (principals) 
and those receiving allocations (agents) . Using a sample of 353 
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management professors across 90 universities, they found that 
number of job changes produces the largest monetary gains. 
Further, the financial returns yielded by job changes tend to be 
greater for individuals with exceptional scholarly records, but 
it pays for faculty members to move regardless of the quality of 
their records. "The highest correlate of job moves is top-tier 
publications (.49), with teaching evaluations (.25), citations 
(.21), second-tier publications (.19), and books (.17) following 
far behind" (p. 940) . Thus, the key argument here is that 
teaching effectiveness is not strongly rewarded by most 
universities and colleges, whereas research productivity is. 

The present author asserts that both the measurement and 
instrumentality issues are highly related. It is possible that 
even with a reliable and valid system of student evaluation of 
teaching effectiveness, teaching effectiveness will not be 
recognized and treated seriously if the reward system is not 
present. 

In the present study, the measurement issue, from students' 
perspective, will be examined. The purpose of the present study 
is to identify major factors of teaching evaluation as related to 
the professors' overall teaching effectiveness. 

Method 

Subjects 

Data were collected in a Fall semester from about 3,200 
undergraduate students and 3 00 graduate students taking courses 
in the College of Business at a regional state university with 
more than 17,000 students located in the southeastern United 
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States. These students rated 126 business faculty (110 full- 
time) in the following five departments: (1) Accounting, (2) 
Business Education , Marketing Education , and Office Management 
(BMOM) , (3) Computer Information Systems, (4) Economics and 
Finance, and (5) Management and Marketing. 

Students attending 114 courses during the evaluation period 
were asked to complete the teaching evaluations anonymously. 
Their confidentiality was assured, A total of 6,395 ratings was 
obtained. Ratings from students who took more than one course 
from different professors and who took more than one course fr^m 
the same instructor were all included. Several professors may 
teach different sections of the same course. 

Out of 6,345 completed evaluations (due to missing data), 
341 were completed by freshman (5.4%), 903 by sophomore (14.2%), 
1,690 by junior (26.6%), 2,719 by senior (42.9%), 602 by graduate 
students (9.5%), and 90 by others (1.4%). A total of 1,127 
evaluations (17.5%) was completed by students who considered 
accounting as their home department, 782 (12.2%) by BMOM, 1,490 
(23.2%) by Economics and Finance, 1,172 (18.2%) by Computer 
Information Systems, and 1,862 (28.9%) by Management and 
Marketing. In terms of students' current cumulative CPA, 62 
(1.0%) reported below 2.00, 1,178 (18.7%) between 2.00 and 2.49, 
2,219 (35.1%) between 2.50 and 2.99, 1,698 (26.9%) between 3.00 
and 3.49, 854 (13.5) above 3.50, and 305 (4.8%) had no grades 
yet. 

Further, 1,717 students (27.3%) expected to receive an A for 
the course, 2,615 (41.%%) a B, 1,651 (26.2%) a C, 274 (4.4%) a D, 
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and 34 (.5%) an F, and 6 (.1%) a passing grade. When asked the 
main reason for taking the course, 1,972 (31,3%) indicated that 
they took the course for general requirement, 651 (10.3%) 
interested in subject, 3,612 (57.2) course in major, 27 (.4%) 
easy course, and 48 (.8%) recommended by another student. 
Measurement 

The 17-item scale, student evaluation of faculty 
performance, has been adopted to evaluate all university faculty 
members in this university for several years. In the present 
study, students from all business classes were asked to rate 
their instructors using these 17 items and one additional item — 
the overall teaching effectiveness. A total of 18 items was 
involved. 

First, 12 items examined students' evaluations of teaching 
performance (please see Table 1) . A 5-point rating scale was 
used with al ost always (1) , usuall y (2) , rarely (3) , never (4) , 
and not applicable (5) as anchors. Second, five (5) additional 
items related students' class status (freshman, sophomore, 
junior, senior, graduate, and other), cumulative GPA (below 2.00, 
2.00 to 2.49, 2.50 to 2.99, 3.00 to 3.49, above 3.49, none yet), 
expected grade (A, B, C, D, F; pass, fail), reason for taking the 
course (general requirement, interested in subject, course in 
major, easy course, and recommended by another student) , and 
class missed (0 to 3, 4 to 7, 8 to 15, more than 15, and went 
only for exams) were included. 

Finally, all students were asked to rate the overall 
performance of the instructor in this course using a 5-point 
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scale with outstanding , above average , average , below average, 
and poor as anchors. These items appear to cover the important 
factors related to the evaluation of teaching effectiveness as 
suggested in the literature (e.g., Centra, 1979). 

Results 

Table 1 shows the means and standard deviations of 12 
teaching evaluation ratings and the overall effectiveness 
measure. The correlations of variables are presented in Table 2. 
Further, all 17 items were used to predict faculty member's 
overall teaching effectiveness using multiple regression analysis 
based on a sample of 5,393 students in the College of Business 
(please see Table 3) . 



Insert Tables 1, 2, and 3 about here 



Table 3 shows that the R Square of the regression analysis 
was .6712. Twelve items were significantly related to the 
overall effectiveness rating. Therefore, 67.12 percent of the 
variance can be explained by these 12 items in the teaching 
evaluations . 

The most important predictors were instructor presents 
material clearly, instructor answers students' questions, treats 
students in a courteous and/or professional manner, and 
instructor appears to be well prepared for each class. Moreover, 
the students' expected grade for the course, the clarity of 
grading criteria, assignments are reported within a reasonable 
amount of time, instructor is accessible to talk with students 
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outside of class, class sessions are relevant to course subject 
matter, classes students have missed, course requirements are 
clear, and classes end on time were all predictors of overall 
teaching effectiveness. 

Discussion 

The results of the present study show that instructor 
presents material clearly, instructor answers students' 
questions, instructor treats students in a courteous and/or 
professional manner, and instructor appears to be well prepared 
for each class are the most important predictors of overall 
teaching effectiveness. These items are similar to the factors 
identified in previous studies such as organization and clarity 
of presentation, communication skill, teacher-student interaction 
or rapport, fairness of grading and examinations, and students' 
self-rated accomplishments (Brightman et al., 1993; Centra, 
1979) • Based on these results, it appears that students can use 
fairly objective and reasonable constructs in evaluating 
instructors. 

Many have argued that teaching evaluations by students are 
not true reflections of teaching performance; they are basically 
a popularity contest (Gomez-Mejia & Balkin, 1992). Therefore, 
teaching evaluations seem to reflect students' satisfaction with 
the instructor. 

It has been reported that as the economy beyond the campus 
gates shrinks and, with it, career opportunities for business 
majors. Therefore, many business schools that expanded their 
programs in the 1980s have experienced a significant drop of 



Teaching Evaluation 
11 



enrollments in management programs. This downturn reverses a 30- 
year trend that peaked in 1990 when 250,000 diplomas in business 
fields were granted (Tooley, 1993) . In order to be competitive 
in the educational market, many universities need to have many 
satisfied customers (i.e., students) to survive. Therefore, we 
can not ignore the importance of teaching evaluations. 

The present data show that many of these items of teaching 
effectiveness reflect teaching benaviors that are under 
instructors' control. Therefore, professors need to be aware of 
the contents of their course materials, the context of teaching 
the course materials, and the students who receive knowledge, 
skills, and information in the teaching process. Both the means, 
i.e., the process of teaching the materials (the procedural 
justice) and the ends, i.e., the materials learned, final grades, 
etc. (the distributive justice) are important in student learning 
(cf . Greenberg, 1987) . Based on results of the present study, 
professors should feel comfortable using this teaching evaluation 
instrument . 

It should be pointed out that at the institution where the 
present data were collected, only the overall teaching 
effectiveness is used by evaluators (i.e., department 
chairperson, peer evaluation committee, and administrators) for 
personnel decisions (i.e., tenure, promotion, merit pay, etc). 
Obviously, many professors receive tremendous amount of intrinsic 
satisfaction teaching courses at the college level. A raving 
evaluation from students is simply an extra pat on the back. 
However, professors who seek to receive extrinsic rewards (e.g., 
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tenure, promotion, merit pay, etc.) need to focus on factors that 
are related to overall teaching effectiveness, because these 
factors may be related to the reward/control systems at major 
universities. More specifically, for those who want to improve 
their teaching effectiveness, they may focus on many of these 
significant items, suggested in the present investigation in order 
to receive raving evaluations. 

Teaching, research, university services, and community 
services are the key missions of university professors. Are 
faculty members paid according to theit levels of performance? 
Are faculty members rewarded based on their excellence in 
teaching or research? Answers to these questions may have 
significant impacts on faculty members' allocation of personal 
time and effort in an academic setting (cf. Reskin, 1977). 

Research shows that the relationship between teaching and 
financial rewards is weak. Stenstrom (1991) pointed out that 
"teaching is generally given low priority — very low priority — in 
our established system of values" (p. 4) . Although empirical 
studies suggest that teaching actually may be more influential 
than perceptions might indicate (Kasten, 1984), the general 
perception is that teaching counts significantly less than does 
research (Schultz, Meade, & Khurana, 1989) and receives less 
weight in tenure decisions than it should. 

Kerr (1975) stated that our society "hopes" that professors 
will not neglect their teaching responsibilities but '-rewards" 
them almost entirely for research and publications. In fact, 
professors with publication-oriented resumes usually will be well 
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received at other universities. As mentioned earlier, the 
primary determinants of management faculty pay are the number of 
top-tier journal publications a faculty member has authored and 
changes in institutional affiliation (Gomez-Mejia & Balkin, 
1992) . 

On the other hand, teaching credentials which are harder to 
document and quantify are much less transferable. The reality is 
that, according to J. Dennis Huston of Rice University, the 1989 
Professor of the year, named by the Carnegie Foundation for the 
Advancement of Teaching, "teaching doesn't bring one job offers; 
publishing a book does" (Toch, 1990, p. 12). The major 
consequences are that excellent professors continue to be 
"locals" or "provincials" and forever be condemned to lower 
salary structures than the "nationals" who engage in marketable 
activity (Van Fleet, 1994) . 

In a recent 1991 issue of Ame rica's Best Colleg es, published 
by U.S. News & World Report , there was a real world story 
concerning the balance (or conflict) between publication and 
teaching at University of California at Irvine. Frank Cannonito, 
a professor of mathematics at UC, was denied a promotion and pay 
raise in 1989 due to the lack of sufficient publications. The 
professor also claimed that "because of his failure as a 
researcher his teaching load was increased by 75 percent" (Toch, 
1990, p. 10). 

"That teaching is a college professor's primary role— rather 
than something meted out in a disciplinary action— would seem 
axiomatic. In reality, however, the venerable dictum 'publish or 
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perish' has become the virtual rule of law on many U.S. campuses, 
where research, not performance in the classroom, is the 
overwhelming factor in determining a professor's status and 
salary 11 (Toch, 1990, p. 10). As a consequence, university 
professors may concentrate on research, even if to the detriment 
of teaching and at the expense of their students. Erich Bloch, 
former director of the National Science Foundation, stated: "In 
the past, the emphasis was on research and teaching. Today, it 
is on research and research" (Toch, 1990, p. 10) . 

Due to the need to publish and find publication outlets, the 
number of science journals alone increased from 8,062 in 1978 to 
37,683 in 1988 (Toch, 1990). On one hand, professors in the U.S. 
have been very prolific in producing research findings and 
discoveries. Research in the U.S. is second to none. On the 
other hand, it is plausible that professors in higher education 
may have failed to upgrade the quality of research and 
scholarship but rather have created a massively wasteful academic 
publishing industry. 

Moreover, the effectiveness of self -regulation in the 
academic profession concerning the enforcement of standards and 
ethical principles for the conduct of research has been 
challenged (Braxton, 1994; Braxton & Bayer, 1994). For the past 
two decades, many cases of scientific misconduct (e.g., 
Baltimore, Bruening, Benvenista, Borer, Darsee, Slutsky, 
Strieker, and Summerlin) have b^en the focus of attention by the 
scientific community and the lay public (Braxton, 1994) . A study 
by the National Science Foundation (Office of Inspector General, 
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1990) found that about 20 percent of the scientists say that they 
have directly encountered fraud. 

In a national sample of 311 tenured biochemists in U.S. 
universities, Braxton and Bayer (1994) found that a professor 
with high intraprof essional status (i.e., publication 
productivity and prestige of academic department) has favorable 
attitudes toward taking action for scientific misconduct. 
Further, with greater perceived institutional pressure for 
receiving external grant monies, a professor is to be inclined 
toward avoiding action that would stigmatize her or him as a 
whistleblower. It is plausible that differnt forms of external 
pressure may have been some of the causes of research misconduct. 
It has been suggested that individual scientists, universities, 
professional associations, journals, government agencies, and 
private foundations are all responsible for detecting and 
deterring scientific wrongdoing (Chubin, 1983) . 

In order to correct this, desirable teaching effectiveness 
needs to be rewarded (Kerr, 1975). Stanford University's Donald 
Kennedy declared bluntly that "junior faculty who show 
outstanding teaching ability fail at the tenure line too often, 
to the dismay of students who understandably wonder about 
Stanford's values. It is time to reaffirm that education — that 
is, teaching in all its forms — is the primary task 11 (p. 10). 
David Gardner, the outgoing president of the UC system, decreed 
that teaching and research will have equal status in pay and 
promotion within the top ranks of full professorships and that 
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peer review will be added to teacher evaluations throughout the 
system (Toch & Wagner, 1992). 

In 1990, the Carnegie Foundation for the Advancement of 
Teaching issued a report arguing that the definition of 
scholarship be expanded to include teaching as a way of achieving 
such a balance (Mooney, 1992) . More recently, many institutions 
are considering a more balanced route between instruction 
(teaching) and scholarship (research) to tenure university 
professors. Some schools, such as Ohio State and Boston College, 
have created "teaching centers" to improve the quality of 
instruction of their campuses. 

Van Fleet (1994) has suggested that a peer review 
infrastructure should be created to support the awarding of 
tenure based on teaching. Further, the two following critical 
components must be present in the evaluation of teaching 
effectiveness: Independence of review and high standards 
relative to others in the field. These two important criteria 
are very similar to those used for publishing articles in a 
journal: Evaluated by external journal reviewers and high 
quality as reflected in acceptance/rejection rates. 

In order to achieve true market value for teaching 
effectiveness, "professional associations must create mechanisms 
for performing such external evaluations" (Vc.n Fleet, 1994, p. 
81) . That is, "to establish currency for teaching in the 
academic marketplace, an infrastructure as closely parallel to 
the one that already exists for research must be created" (p. 
83) . 
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Further r management professors also need to be aware of the 
fact that management education is under close scrutiny and 
criticism for being irrelevant (Ford, 1994) . A strong link 
between theory and practice is needed. Further, academicians 
need to teach not only theoretical knowledge of functional 
specialities but also pragmatic capabilities or operational 
knowledge, e.g., creativity, people skills, aptitude for 
teamwork, and the ability to write and speak clearly and 
concisely ( The Christian Science Monitor , 1991) . 

Moreover, current methods of management education will not 
provide the education necessary for managers of the 21st century. 
Management professors have to re-examine the assumptions that 
undergird our success. Major changes in management education may 
also include changes in curriculum (e.g., international business, 
technology management, and interdisciplinary study) , pedagogy 
(e.g., computer simulations, field studies, mentors, etc.), and 
operational education (Porter & McKibbin, 1988) . These changes 
deal with not only for what we teach, but how we teach it. 

With major changes in these directions, it is expected that 
the measurement of teaching effectiveness will be changed 
dramatically in the future. Further, teaching evaluations will 
be valued highly and taken seriously by university professors in 
the future if the reward system is in place. Although the 
present author has not examined all these issues and variables in 
examining the students' evaluation of teaching effectiveness, 
future research should incorporate these variables in a more 
comprehensive model of teaching and research in higher 
education. 
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Table 1 

Means and Standard Deviations of Variables 



Variables M £B 



1. Well prepared for each class 1.33 .58 

2. Answers student's questions effectively 1.65 .77 

3. Presents material clearly 1.73 .79 

4. Accessible to talk with students on course 

matters outside of class 1.75 1.11 

5. Relevant to course subject matter 1.34 .59 

6. Course requirements are clear 1.41 .66 

7. Grading criteria for the course as a whole 

are clear 1.45 .69 

8. Exam results are reported within a reasonable 

amount of time 1.3 3 .64 

9. Assignments results are reported within a 

reasonable amount of time 1.7 3 1.23. 

10. Treats students in a courteous and/or 

professional manner 1.39 .65 

11. The class begins at scheduled times 1.22 .49 

12. The class usually ends (on time, early, 

late) 1.21 .55 

13. Overall Effectiveness 2.16 1.01 



Note. N varies between 5636 and 6395 
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Table 2 

Correlations of Variables 
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Note. See Tables 1 and 2 for variable names. All decimals have been 
omitted for correlations. If r = .02, e < .05. N varies between 5,548 
and 6,395. 
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Regression 
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R Square = .6712 










F (17, 5,376) = 


64 5.53, £ = 


.0001. 







Note. N = 5393. 
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